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PREFACE 

This  document  was  prepared  by  the  Institute  for  Defense  Analyses  (IDA)  for  IDA's 
Independent  Resetirch  Program,  under  contract  MDA  903  89  C  0003.  The  objective  of  the 
project  was  to  investigate  the  possibility  of  developing  quarntative  relationships  for 
predicting  the  costs  of  initial  spares. 

This  paper  w-as  reviewed  within  IDA  by  Mr.  James  L.  Wilson  and  Dr.  Matthew  S. 
Goldberg,  and  by  Dr.  Thomas  R.  Gulledge,  an  IDA  consultant. 
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r.  INTRODUCTION 


This  paper  reports  the  results  ofetfons  to  develop  Cost  Estimating  Relationships 
(CERs)  for  initial  spares.  Initial  spares  are  those  that  accompany  the  first  deployments  of 
each  new  aircraft  squadron,  and  that  are  intended  to  satisfy  the  squadron's  needs  for  a  short 
time  until  the  system  establishes  a  regular  now  of  replenishment  spares.  Because  this 
analysis  is  concerned  with  initial  spares  only,  we  will  use  the  term  "spares"  to  refer  to 
initial  spares. 

The  beneficiaries  of  a  CER  for  spares  are  -ervice  and  OSO  budget  planners  wim 
must  program  funds  for  these  support  items.  Initial  spending  plans  must  be  made  long 
before  any  aircraft  are  deployed.  Spares  funds  must  therefore  be  programmed  before 
failure  data  has  been  generated,  and  budget  planners  sometimes  rely  on  historical  data  for 
existing  or  past  aircraft  witl.  similar  characteristics  of  weight,  speed,  mission,  complexity, 
etc.  These  analysts  sometimes,  for  example,  use  the  ratio  of  spending  for  initial  spares  to 
spending  for  flyaway  or  weapon  system  costs,  and  use  these  ratios  to  estimate  costs  for  a 
new  aircraft.  We  have  tried  a  larger  class  of  relationships  in  searching  for  CERs. 

In  this  analysis,  we  assume  that  what  the  services  have  spent  is  a  proxy  for  how 
much  they  should  have  spent.  This,  of  course,  ignores  questions  of  operational 
performance  that  are  important  in  making  ultimate  judgments  of  whether  a  budget  is 
adequate.  (Did  the  sortie  rate  suffer  because  initial  spares  were  unavailable?)  These 
considerations  were  beyond  the  scope  of  this  study.  We  have,  however,  based  our 
estimating  relationships  on  actual  budgets,  rather  than  programmed  funds.  Programmed 
figures  are  often  not  "serious"  until  the  time  comes  for  actual  spending.  Using  a  CER 
based  on  past  spending  thus  serves  the  purpose  of  requiring  budget  analysts  to  insert 
realisitic  funds  early  in  the  programming  process.' 


Even  "actual"  budgets  ignore  ihc  rc-programming  that  occurs  during  the  budget  year. 


11.  METHODOLOGY 


We  constructed  CERs  for  initial  spares  by  hypothesizing  relationships  and  applying 
statistical  regression  techniques  to  historical  data  for  21  past  Navy  and  Air  Force  aircraft 
programs.  In  each  case,  the  dependent  variahie  one  of  several  measures  of  spending 
on  initial  spares.  The  e.xplanatory,  or  independent  variables  included  spending  on  weapon 
SN  stem  cost,  the  empty  weight  and  maximum  speed  of  the  aircraft,  and  dummy  variables  to 
control  for  the  type  of  aircraft. 

We  selected  a  sample  of  aircraft  programs  in  the  following  manner.  We  considered 
only  those  aircraft  for  which  we  had  data  for  the  entire  program.  This  eliminated  programs 
still  in  progress  in  FY  1994,  the  last  year  of  the  data.  We  also  eliminated  programs  that  had 
already  begun  in  the  first  year  of  the  data,  1972.  The  entries  for  this  year  are.  in  reality,  for 
"1972  and  prior,”  and  adjusting  these  figures  to  constant  dollars  would  have  required  us  to 
guess  at  how  the  then-year  aollars  were  distributed  over  the  prior  years,  and  thus  what 
deflators  to  use. 

Finally,  to  avoid  the  unreality  of  programmed  budgets,  we  included  only  those 
programs  for  which  at  least  70  percent  of  the  spending  (in  constant  dollars)  occurred  in  FY 
1988  or  prior,  the  last  year  of  "actual"  budgets  in  the  data  source  we  used.  (Only  one  of 
the  programs  was  70  percent  "actual";  the  remainder  were  at  least  96  percent.) 

We  looked  for  relationships  that  satisfied  several  criteria;  (1)  positive  signs  for  the 
coefficients  of  the  explanatory  variables  (faster  aircraft,  for  example,  should  require  more 
or  costlier  spares),  (2)  high  R2,  indicating  that  the  regression  explained  a  large  percentage 
of  the  variability  in  spares  expenditures,  and  (3)  high  t-statistics  (high  statistical 
significance)  for  the  coefficients  of  the  independent  variables.  (High  R’’  was  given  more 
weight  than  high  t-statistics,  since  the  goal  of  the  analysis  was  to  develop  a  predictive 
relationship  for  spares  expenditures,  rather  than  to  identify  the  specific  contribution  of  each 
explanatory  variable.) 


IIL  DATA 


The  data  are  shown  in  Table  1 .  The  column  titles  tire  the  names  of  variables  used  in 
reporting  the  results  of  the  regressions;  complete  definitions  are  given  at  the  bottom  of  the 
table. 


SPARES,  WSC  and  QTY  were  all  obtained  from  the  historical  Procurement  Annex 
0  for  FY  1989  covering  the  fiscal  years  1972-1994.  SPARES  is  the  total  obligational 

authority  (TOAi  for  procurement  of  initial  spares  during  the  life  of  the  program.  The  then- 
year  dollars  in  the  Procuremeiu  Annex  were  inflated  to  FY  1989  using  detlators  for 
"Procurement  of  Aircraft.  Navy"  and  "Procurement  of  Aircraft,  .Air  Force." 

•  WSC  stands  for  "W^_dpon  System  Cost,"  which  consists,  for  the  most  part,  of  total 
procurement  TOA  less  spares.^ 

Empty  w'eight  and  maximum  speed  of  the  aircraft  were  obtained  from  "Standard 
Aircraft  Missile  Characteristics"  (a  series  of  documents  on  military  aircraft,  distributed  by 

*  the  Aeronautical  Systems  Division  at  Wright-Patterson  Air  Force  Base.  Ohio)  and  "Jane  s 
.All  The  World's  Aircraft"  (a  standard  reference  on  all  aircraft,  published  yearly).  Some  of 
the  figures  are  approximations,  equal  to  values  for  different  models  of  the  same  basic 
aircrttft,  or  for  the  civilian  version  of  the  military  aircraft. 

Cl  and  C2  are  dummy  variables  describing  the  type  of  aircraft.  Ci  was  set  to  1  for 
the  more  complex,  fixed-wing  aircraft  (attack,  fighter,  electronic  and  bombers)  and  to  0  for 
all  other  aircraft.  C2  was  set  to  1  for  the  cargo  and  tanker  fixed-wing  aircraft,  and  to  0  for 
^  ail  other  aircraft.  Helicopters  are  the  excluded  case,  for  which  both  Ci  and  C2  are  0. 


Vtorc  spccincally,  WSC  consists  of  flyaway  co.st  (non-recurring  plus  recurring  costs  for  airframe, 
propulsion  and  avionics,  program  management,  test  and  evaluation,  allowances  for  engineering 
changes)  plus  uaming,  peculiar  support  equipment  and  site  costs  Procurement  TOA  consists  of 
Weapon  System  Cost  Ics.s  advance  spending  for  the  prior  year,  plus  advance  spending  for  the  next  year, 
plus  spending  for  initial  spares. 
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Table  1.  Data 


Aircraft 

SPARES 

wsC 

QTY 

WEIGHT 

SPEED 

c, 

C2 

.A-lOA 

511.4 

7,431.7 

687 

21,500 

362 

1 

0 

A-7K 

27.7 

500.9 

30 

21,300 

569 

1 

0 

C-130H 

31.0 

1,939.4 

130 

76,800 

335 

0 

1 

C-20A 

22. 1 

217.6 

11 

38,000 

501 

0 

1 

CH-47C 

3.0 

119.7 

24 

20,400 

165 

0 

0 

E-3A 

423.2 

4.438.5 

31 

170,700 

473 

1 

0 

E-4A/B 

5.1 

279.3 

3 

307,300 

536 

1 

0 

F-5B 

0,3 

31.2 

7 

8,400 

710 

1 

0 

F-5E/F 

0.5 

57.6 

6 

10,000 

915 

1 

0 

KC-lOA 

301.3 

4,332.5 

60 

236.500 

529 

0 

1 

KC-130T 

5.7 

402.1 

20 

66.200 

326 

0 

1 

UH-60A 

10.1 

65.3 

11 

10.600 

160 

0 

0 

VH-3D 

19.0 

111.9 

11 

10,800 

144 

0 

0 

VH-60 

41.3 

178.3 

9 

10.600 

160 

0 

0 

C-5B 

165.1 

7,747.8 

50 

374.000 

571 

0 

1 

A-6 

358.3 

6,003.3 

205 

24,600 

561 

1 

0 

F-15D/E 

2,625.6 

38,359.9 

1,128 

26,800 

1.434 

1 

0 

CH/MH-53 

276.8 

3,086.3 

152 

23,100 

186 

0 

0 

SH-2F 

27.5 

689.4 

60 

7.000 

143 

0 

0 

AV-8B 

740.4 

6,862.1 

276 

13,100 

533 

1 

0 

B-!B 

1,616.2 

25,584.2 

100 

192,000 

630 

1 

0 

Notes:  SPARES  =  Total-program  TOA  for  initial  spares  in  millions  of  FY  1989  Jollars.  WSC  = 
Total-program  TOA  for  weapon  system  cost  in  millions  of  FY  1989  dollars.  QTY  =  Total- 
program  procurement  quantity.  WEIGHT  =  Aircraft  empty  weight  in  pounds.  SPEED  =  Aircraft 
maximum  speed  in  knots.  Cj  =  1  for  attack,  fighter,  electronic,  and  bomber  aircraft;  0  for  all 
others.  C2  =  I  for  cargo  and  tanker  aircraft;  0  for  all  others. 
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IV.  ANALYSIS 


We  found  four  predictive  equations  for  spares  cost  that  passed  our  cntena.  tv.o 
using  weapon  system  cost  as  the  dependent  variable,  and  two  using  procurement  quanta;.' 
and  the  charactenstics  of  the  aircraft  (weight,  speed,  and  the  type  dummies).  These  will  he 
discussed  in  turn. 

A.  LSI\G  WEAPON  SYSTEM  COST  AS  THE  E.XPLANATORY 

variable 

The  first  model  (eq.  ! )  involves  a  linear  relationship  between  spares  cost  and  WSC; 
each  increase  of  a  billion  dollars  in  WSC  leads  to  a  $66.7  million  increase  in  spaies  c'osi. 
The  equation  has  high  explanatory  power,  the  value  of  R-  indicates  that  the  equation 
accounts  for  fully  97  percent  of  the  variability  in  spares  cost.  TTie  astensks  indicate  that  the 
coefficient  of  WSC  has  high  statistical  significance.  (One.  two  and  three  asterisks 
represent  significance  at  the  10,  5  and  1  percent  levels,  respectively.)  Adding  the  dummy 
vanables  to  the  equarion  had  little  effect  on  the  coefficients,  t-statistics  or  R^.  indicating  that 
the  relationship  between  spares  cost  and  WSC  does  not  vary  greatly  with  the  type  i.d' 
aircraft. 

SPARES  = -1.23  +  .0667  WSC  R' -  .97  ih 

★  ★ 


In  the  second  model  (eq.  2),  the  relationship  between  spares  cost  and  weapon 
system  cost  is  a  proportional  one;  Every  10  percent  increase  in  WSC  leads  to  an  1 1  percent 
( 10%  X  1.10)  increase  in  spares  cost.-^  The  equation’s  predictive  power  (R-)  is  somew  hat 
and,  before,  controlling  for  aircraft  type  made  little  difference. 

SPARES  =  .0242  (WSC)' R' =  .X6  (2) 


-  The  regressions  in  eq.  (2)  and  (4)  were  obtained  by  expressing  the  variables  loxeliiding  the  dunimv 
vanables)  in  logarithmic  form,  performing  a  linear  regression,  and  then  lakmg  the  anii-log  of  die  rcsiiii 
to  obtain  die  more  convenient  exponential  form  given  in  the  text. 
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Choosing  beiueen  the  linear  and  log  (exponential)  form  of  a  CER  depends  on  the  analyst's 
best  intuition  about  the  underlying  relationships.  We  plan  to  explore  this  question  more 
fully  in  later  ur 

B.  rSiNC,  quantity,  weight  .4ND  SPEED  .\S  THE  EXPLaN ATOR'i 
variables 


Tne  final  regressions  illustrate  the  kinds  of  relationships  that  budget  analysts  could 
use  if  the\'  lack  estimates  of  weapon  system  cost  but  have  at  least  initial  estimates  of  the 
uircraft'N  weight,  speed,  and  procurement  quantity.  In  equation  .U  quantity,  weight  and 
speed  have  a  linear  effect  on  spares  cost;  Each  additional  aircraft  adds  approximateK  S’.  5 
million  to  spares  cost,  each  additional  1,000  pounds  of  weight  adds  about  STOO.OOO.  and 
each  10  knot  increase  in  speed  adds  S6.2  million.  The  explanatory.'  power  of  this  model  is 
less  than  for  the  models  that  predict  cost  from  WSC,  hut  the  R-  of  .72  suggests  that  the 
equ.iiion  might  be  useful  as  a  first  cut.  As  before,  controlling  for  the  type  of  aircraft  did 
httle  to  increase  the  equation's  predictive  power. 

SPARES  =  -225.4  +  1.53  QTY  +  0.000705  WEIGHT  +  0.620  SPEED  i  3i 

R‘=.72 

'['he  final  mode!  (eq.  4)  is  an  exponential  relationship  of  the  same  variables.  It  has 
somewhat  higher  predictive  powci  than  the  linear  form.  The  dummy  variables  for  aircraft 
type  now  make  a  measurable  contribution;  the  fact  that  the  coefficients  of  these  variables  are 
both  negative  suggests  that  budget  analysts  have  been  buying  fewer  spares  tin  dollar  terms) 
for  the  fixed-wing  aircraft  than  for  helipcopters  (the  excluded  case,  in  which  Ci=C2=0). 


SPARES  =  .0000163  QTy' ■\vE1GHt'’ '^■\sPEEd" '^'e  a  ' 

*  ★  *  ★  * 

R"=.79 


(4) 


S 


V.  DISCLSSIOX 


We  have  found  several  models  that  exhibit  good  fits  and  intuitively  plea'^ing 
lesuhs,^  Tliese  results  show  that  funds  for  initial  spares  are  not  random,  but  can  be  related 
to  \  anables  such  as  pn.igram  cost  and  aircraft  characteristics. 

flow  ever,  we  tried  many  other  m-odels  that  appeared  attractive  but  failed  to  meet  isur 
criteria  on  one  or  more  grounds;  negative  signs  for  the  coefficients  of  weieht  and  speed, 
l('w  R-,  low  t-starisncs.  We  obtained  poor  results,  for  example,  in  trying  to  predict  unit 
spares  cost,  and  also  the  ratio  of  spares  cost  to  weapon  system  cost.  .A  particular!'. 
Mirpri.sing  result  is  the  case  in  which  we  used  the  proportional  specification  to  relate  ''pare■^ 
cost  to  both  the  program  variables  (WSC  and  procurement  quantity)  plus  the  aircraft 
cnaractenstics  (weight  and  speed).  The  R-  was  almost  .9.^  and  the  variables  were  all 
;ughly  significant,  but  quantity,  weight  and  speed  all  had  negative  signs!  This  suggests 
that  there  are  missing  important  variables,  and  we  need  to  obtain  a  better  understanding  of 
the  results. 

To  help  in  this  regard,  we  plan  in  future  work  to  construct  separate  explanatory 
vanables  for  airframe,  engine  and  avionics.  (Using  separate  weights  for  each  component  is 
a  possibility.)  W'e  will  also  attempt  to  increase  the  number  of  aircraft  programs  in  the 
sample,  rinally,  w-e  will  explore  the  pattern  of  how  budget  planners  have  apportioned 
funds  for  initial  spares  over  the  program  years.  Tlie  eventual  goal  is  a  set  of  relationships 
that  will  help  planners  decide  not  only  how  large  a  spares  budget  is  needed  for  a  new 
aircraft  program,  but  also  how'  to  program  this  budget  over  time. 


'  One  possible  interpretation  of  these  rc.suli.s  is  that  we  have  simply  discovered  the  "rule  '  ihai  analysis 
have  been  using  in  budgciing  for  iniual  spares.  This  mighi  he  a  compelling  hypothesis  if  our  data  wa.s 
lakcn  primarily  from  aircraft  programs  that  have  not  yet  reached  IOC  (initial  operational  capahiiits ) 
However,  as  w'e  discussed  earlier,  all  of  the  programs  arc  well  over  half  complcicd,  and  the  spending 
data  arc  largely  "actuals"  rather  than  future  projections.  Whatever  budgetary  manipulations  may  h;i\o 
gone  on  before,  we  assume  that  once  an  aircra/t  reaches  deployment,  ihc  Services  have  taken  care  lo 
buy  enough  spares  lo  support  die  aircraft  adequately. 
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